DALL·E is a 12-billion parameter version of GPT-3 trained to generate images from text descriptions, using a dataset of text–image pairs. It has a diverse set of capabilities, including creating anthropomorphized versions of animals and objects, combining unrelated concepts in plausible ways, rendering text, and applying transformations to existing images. In short it is phenomenal! Make sure to subscribe to the channel Deep Learning Explainer, please. OpenAI achieves insanely great results using GPT-3 in a system called DALL-E to generate very credible images from text descriptions alone.

DALL·E[1] is a 12-billion parameter version of GPT-3 trained to generate images from text descriptions, using a dataset of text–image pairs. We've found that it has a diverse set of capabilities, including creating anthropomorphized versions of animals and objects, combining unrelated concepts in plausible ways, rendering text, and applying transformations to existing images. GPT-3 showed that language can be used to instruct a large neural network to perform a variety of text generation tasks. Image GPT showed that the same type of neural network can also be used to generate images with high fidelity. We extend these findings to show that manipulating visual concepts through language is now within reach.

Summary: Combining EEG brain function data, brain-computer interface technology, and artificial intelligence, researchers have created a system that can generate an image of what a person is thinking. Researchers at the University of Helsinki have developed a technique in which a computer models visual perception by monitoring human brain signals. In a way, it is as if the computer tries to imagine what a human is thinking about. As a result of this imagining, the computer is able to produce entirely new information, such as fictional images that were never before seen. The technique is based on a novel brain-computer interface.

The folks at Google's DeepMind are hard at work bringing the world the latest developments in artificial intelligence (AI). Their latest breakthrough shows that their AI is capable of creating photorealistic pictures from human input in the form of sentences. This is the latest development in the use of AI to do some truly amazing things with pictures. In February, Google Brain scientists developed a way to "enhance" photographs much like the way you might see in a science fiction movie like Blade Runner or a network procedural like one of the many CSIs. Using PixelCNN, the machine was able to turn low-resolution photos into high-resolution ones with an impressive approximation.